Senior Data Engineer II

Senior Data Engineer II - Chubb External Careers

• Utilize the data engineering skills within and outside of the developing Chubb information ecosystem for discovery, analytics and data management.
• Work with data science team to deploy Machine Learning Models.
• You will be using Data wrangling techniques converting one raw form into another including data visualization, data aggregation, training a statistical model etc.
• Clean, unify and organize messy and complex structured/unstructured data sets for easy access and analysis.
• Create different levels of abstractions of data depending on analytics needs.
• Hands on data preparation activities using the Azure technology stack especially Azure Databricks is strongly preferred.
• Implement discovery solutions for high speed data ingestion.
• Work closely with the Data Science team to perform complex analytics and data preparation tasks.
• Work with the Data Engineers/IT team to develop APIs.
• Sourcing data from multiple applications, profiling, cleansing and conforming to create master data sets for analytics use.
• Utilize state of the art methods for data manning especially unstructured data.
• Design solutions for managing highly complex business rules within the Azure ecosystem.
• Performance tune data loads.

• Knowledge of Python and Pyspark is an absolute must.
• Knowledge of Azure, Hadoop 2.0 ecosystems, HDFS, MapReduce, Hive, Pig, Sqoop, Mahout, Spark is important for this role.
• Experience with Web Scraping frameworks (Scrapy or Beautiful Soup or similar).
• Extensive experience working with Data APIs (Working with REST endpoints and/or SOAP).
• Significant programming experience (with above technologies as well as Java, R and Python on Linux).
• Knowledge of any commercial distribution application such as Horton Works, Cloudera, MapR etc.
• Excellent working knowledge of relational databases, MySOraQL, cle etc.
• Experience with Complex Data Parsing (Big Data Parser) a must. Should have worked on XML, JSON and other custom Complex Data Parsing formats.
• Natural Language Processing (NLP) skills with experience in Apache Solr, Python a plus.
• Knowledge of High-Speed Data Ingestion, Real-Time Data Collection and Streaming is a plus.

• 401k matching
• Health insurance
• Flight privileges
• Savings and Investment plans
• Upskilling and career growth opportunities
• Health and Welfare Benefits

Chubb is a world leader in insurance. With operations in 54 countries and territories, Chubb provides commercial and personal property and casualty insurance, personal accident and supplemental health insurance, reinsurance and life insurance to a diverse group of clients. The company is defined by its extensive product and service offerings, broad distribution capabilities, exceptional financial strength and local operations globally. Parent company Chubb Limited is listed on the New York Stock Exchange (NYSE: CB) and is a component of the S&P 500 index. Chubb employs approximately 43,000 people worldwide. Additional information can be found at www.chubb.com.